| |
|
|
|
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions.
The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.
By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with |
| « read more about Robots.txt 2.0 |
|
|
RECOMMENDED DOWNLOADS IN THIS CATEGORY
|
|
|
|
| » tc.SimpleWebServer 2.07
|
| Simple, function-related Webserver with optional script support (Perl, PHP). CD-ROM Support!! Usable also as a Control client for tc.WebCheck. Installation of tc.SimpleWebServer is like a quite normal program: it installs himself in only one single direc ... |
|
| Yourinfosystem.de | 0 | Win 95/NT/2000/XP/98/ME | E59 | Downloads: 1656 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » AbsoluteEdit 1 User License 1.1
|
| AbsoluteEdit is a full-featured text editor designed for Active Server Pages (ASP) authors. This software helps you to edit ASP programs using Project/File Manager, Syntax Highlighting, Code Auto-Completion and Popup Member List, Code Explorer, and mor ... |
|
| Absoluteedit.com | 0 | Win 95/NT/2000/XP/98/ME | $29 | Downloads: 2043 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » QAEWT QuizMaker v1.0 Non-Profit License 1.0
|
| QAEWT QuizMaker 1.0 is a Windows and Macintosh friendly tool for creating web based quizes. It uses a WYSIWYG Java application in which a quiz can be created and tested. The quiz is then saved as a data file and a sample applet call is automatically saved ... |
|
| Qaewt.com | 0 | Win 95Macintosh /2000/XP/98/ME | $19.95 | Downloads: 1676 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » AbsoluteEdit 5 User License 1.1
|
| AbsoluteEdit is a full-featured text editor designed for Active Server Pages (ASP) authors. This software helps you to edit ASP programs using Project/File Manager, Syntax Highlighting, Code Auto-Completion and Popup Member List, Code Explorer, and mor ... |
|
| Absoluteedit.com | 0 | Win 95/NT/2000/XP/98/ME | $125 | Downloads: 1773 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » AbsoluteEdit 10 User License 1.1
|
| AbsoluteEdit is a full-featured text editor designed for Active Server Pages (ASP) authors. This software helps you to edit ASP programs using Project/File Manager, Syntax Highlighting, Code Auto-Completion and Popup Member List, Code Explorer, and mor ... |
|
| Absoluteedit.com | 0 | Win 95/NT/2000/XP/98/ME | $180 | Downloads: 1659 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » AbsoluteEdit 20 User License 1.1
|
| AbsoluteEdit is a full-featured text editor designed for Active Server Pages (ASP) authors. This software helps you to edit ASP programs using Project/File Manager, Syntax Highlighting, Code Auto-Completion and Popup Member List, Code Explorer, and mor ... |
|
| Absoluteedit.com | 0 | Win 95/NT/2000/XP/98/ME | $300 | Downloads: 1694 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » AbsoluteEdit Universal User License 1.1
|
| AbsoluteEdit is a full-featured text editor designed for Active Server Pages (ASP) authors. This software helps you to edit ASP programs using Project/File Manager, Syntax Highlighting, Code Auto-Completion and Popup Member List, Code Explorer, and mor ... |
|
| Absoluteedit.com | 0 | Win 95/NT/2000/XP/98/ME | $450 | Downloads: 1718 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » EasyASP 2.0
|
| EasyASP generates ASP scripts (pages that contain sequences of commands) for querying and modify a data base`s tables. You just visually select the tables that you wish to generate scripts for, the actions allowed on each table and on each table`s field, ... |
|
| Com.ar | 0 | Win 95/NT/2000/XP/98/ME | $15 | Downloads: 1820 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » HTML Password Lock 1.2.8
|
| Encrypt and password protect html pages, web pages and whole web site. Based on strong algorithms, it will thoroughly encrypt your entire page so that no one can getting in unless he know the correct password. And the encrypted web page can work anywhere ... |
|
| Htmlpassword.com | 0 | Win 95/NT/2000/XP/98/ME | $44.95 | Downloads: 1701 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » QAEWT QuizMaker v1.0 Commercial License 1.0
|
| QAEWT QuizMaker 1.0 is a Windows and Macintosh friendly tool for creating web based quizes. It uses a WYSIWYG Java application in which a quiz can be created and tested. The quiz is then saved as a data file and a sample applet call is automatically saved ... |
|
| Qaewt.com | 0 | Win 95Macintosh /2000/XP/98/ME | $49.95 | Downloads: 1644 |
| Date added: Sep 23, 2005 |
» Details |
|
|
|
|
| » eQuercus Pro 1.21
|
| eQuercus is a product for simplified creation and management of web sites in various languages. Management of the structure (navigation menu) and contents is done with only a few clicks just using a browser and the information is entered in a database. So ... |
|
| Equercus.com | 0 | Win NT/2000/XP | $149 | Downloads: 1771 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » First Level Upgrade for Web Encrypt 3 1.0
|
| Web Encrypt is a web development tool for protecting and compressing web sites and web pages. This software is based on 3 scientific papers we presented on IT and Computer Science conferences, sponsored by Microsoft, Dell, Cisco and others. You can encry ... |
|
| Co.yu | 0 | Win 95/NT/2000/XP/98/ME | $25 | Downloads: 1626 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Web Encrypt 3 3.0
|
| Web Encrypt is a web development tool for protecting and compressing web sites and web pages. This software is based on 3 scientific papers we presented on IT and Computer Science conferences, sponsored by Microsoft, Dell, Cisco and others. You can encry ... |
|
| Co.yu | 0 | Win 95/NT/2000/XP/98/ME | $29.99 | Downloads: 1576 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » NATATA eBook Compiler PRO 2.0
|
| Natata eBook Compiler is an powerful software that packs and compresses multiple files including HTML, CSS, WAV, TXT, GIF, JPG, MID, JavaScript, DHTML, Flash, PDF, etc and converts them into a single compact executable file which contains a small viewer t ... |
|
| Hn3.net | 0 | Win 95/NT/2000/XP/98/ME | $39.99 | Downloads: 1654 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » VRsky 3DChat world [Type A] 1.0 Type A
|
| Introduction: 300$/year Max user number at the same time: 10 Do you want get own 3D community ? as your 3D homepage,stage party... * it is seem just as 3D game ,support stream video and audio(realplayer format : .ra .rm .ram) * you can multiuser chat ... |
|
| VRsky.com | 0 | Win 95/NT/2000/XP/98/ME | $200 | Downloads: 1661 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » ICE iMAP 1.0
|
| ICE iMAP v1.1 - Visual Image Mapper ICE iMap is a visual image-mapping program for Windows. ICE iMap enabled a real-time `WYSIWYG` editing and supports each of the major image-map formats NCSA, CERN and CSIM. ICE iMap is easy to learn and easy t ... |
|
| Ice-technologies.com | 0 | Win 95/NT/2000/XP/98/ME | $21.51 | Downloads: 1732 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Validation Processor Control (Web Site License) 1.1
|
| New! Validation Processor Control The Validation Processor control automatically highlights all form fields with errors, auto focuses the cursor on the first error, provides a complete error summary with the ability to jump to any error listed, and w ... |
|
| 360impact.com | 0 | Win 2000/XP | $55 | Downloads: 3884 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Validation Processor Control (Server License) 1.1
|
| New! Validation Processor Control The Validation Processor control automatically highlights all form fields with errors, auto focuses the cursor on the first error, provides a complete error summary with the ability to jump to any error listed, and w ... |
|
| 360impact.com | 0 | Win 2000/XP | $160 | Downloads: 1538 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Group Validator (Web Site License) 1.0
|
| New! Group Validator The Group Validator is the easiest, most comprehensive group validation solution on the market. 360 IMPACT`s Group Validator control allows you to treat groups of fields as a single unit, and works with the validation s ... |
|
| 360impact.com | 0 | Win 2000/XP | $30 | Downloads: 1645 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Group Validator (Server License) 1.0
|
| New! Group Validator The Group Validator is the easiest, most comprehensive group validation solution on the market. 360 IMPACT`s Group Validator control allows you to treat groups of fields as a single unit, and works with the validation s ... |
|
| 360impact.com | 0 | Win 2000/XP | $85 | Downloads: 1660 |
| Date added: Sep 23, 2005 |
» Details |
|
|
|
|
| |
